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l_i_Introductign^  The  strong  Markov  ■  property  of  a  process  X  at 


a  stopping  time  "T, 


A- 

.p[e^*Xt  '/^]  =  Q  a.s. , 


may  be  split  into  a  conditional  independence  part. 


p[e^*xe‘|^]  =  pfe^»xe*jx^]  a.s. 


and  a  homogeneity  part, 


r  ^ 

P[©  »  xe-  |X^]  =  O  a.s. 


(See  Section  2  for  notation.)  However,  it  is  known  that  condition 


(H)  alone,  for  all  extended  valued  stopping  times  T,  implies  the 


strong  Markov  property  (SM)  for  all  T.  (Cf.  Blumenthal  and  Getoor 


[2],  Proposition  8.2.) 

A  related  result  was  obtained  as  Corollary  2.5  of  [sj,  where  it 


was  shown,  in  the  discrete  time  case,  that  recurrence  at  every 


state  plus  the  validity  of  (H)  for  every  finite  stopping  time  will 


force  X  to  be  a  Markov  chain  (and  then  automatically  strong  Markov) 


This  can  easily  be  seen  directly  (as  pointed  out  to  me  by  H.  Follmer 


and  M.  Jacobsen) ,  but  it  was  originally  deduced  from  a  general  result 


in  exchangeability,  via  a  characterization  of  recurrent  and  locally 


homogeneous  sequences  as  mixtures  of  Markov  chains.  (In  this  paper. 


mixing  will  always  refer  to  the  associated  probability  measures.) 


By  iocaJ  h^oijencity  is  meant  that  0^*X  and  9^i>x  .should 


have  the  same  distribution  for  every  pair  of  stopping  times  cr  and  T 


such  that  X  and  X_  are  non-random  and  equal.  Note  that  this  is  the 


same  as  condition  (H)  for  all  stopping  times  T  with  fixed  Xj.. 


Extensions  of  these  results  to  the  continuous  time  case  were  attempted 


in  Section  4  of  [5],  and  a  further  discussion  was  given  in  [6). 


The  present  work  emerged  from  an  attempt  to  find  a  unified 


approach  to  these  results,  and  to  develop  a  general  theory,  linking 


the  three  conditions  (SM) ,  (Cl)  and  (H) ,  both  in  discrete  and 
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continuous  time.  As  it  turns  out,  an  appropriate  hypothesis 


is  to  assume  that  (H)  should  hold  a.s.  in  the  set  [x^eB},  for  every 
stopping  time  T  such  that  X^eF  a.s.  Here  F  is  a  closed  subset  of 


the  state  space  S,  while  B  is  a  Eorel  subset  of  F,  and  it  is  further 


assumed  that  X  is  recurrent  in  F,  in  the  sense  that 


r-F ,  —  Ca. 


a.  j) 


For  convenience,  the  above  conditions  will  be  labelled  H(F,R) 


Note  that  recurrence  holds  automatically  when  F=S.  Thus  H(S,B) 


means  simply  that  (H)  should  hold  a.s.  on  [x,.tBj  for  every  finite 


stopping  tim.e  T.  As  a  special  case  of  Theorem  2  below,  it  will  be 


seen  that  X  is  a  strong  Markov  process,  whenever  H(S,S)  is  fulfilled. 


without  any  further  recurrence  conditions  on  X.  This  result  (mentioned 


already  in  fSJ)  improves  the  characterizations  of  Markov  processes 


and  chains  given  in  C5J.  More  generally,  it  will  be  seen  that  H(S,B) 


for  an  arbitrary  B  implies  regeneracy  in  B,  in  the  sense  that  (SM) 


will  hold  a.s.  in  {X^%B|  for  every  stopping  time  T. 

The  situation  becomes  more  complex  when  F  is  a  proper  subset 


of  S.  In  that  case  we  can  only  prove  that  X  regenerates  in  a 


certain  subset  B  of  E,  to  be  referred  to  as  the  regular  part.  The 


regeneracy  may  fail  in  the  remaining  singular  part  B^,  but  Theorem  3 


shows  that  (SM)  remains  conditionally  true  in  a  suitable  sense. 


given  the  O-field  induced  by  the  shift  invariant  sets.  Indeed,  we 


shall  even  prove  the  stronoer  statement  that  X  is  a  mixture  of 


processes  regenerating  in  B  ,  and  we  shall  give  an  explicit 

s 


expression  for  the  associated  transition  kernel. 


To  get  a  proper  understanding  of  these  results  and  their  proofs. 


it  is  necessary  to  look  at  other  ways  of  characterizing  the  sets 


B  and  B  .  The  original  definition  is  analytical,  in  terms 

IT  S 


of  the  kernel  Q,  but  Theorem  1  gives  alternative  descriptions  in  terms 


of  the  sample  path  behavior  of  X.  When  both  F  and  B  reduce  to  a 


single  state  s,  it  turns  out  that  B^=B={sj ,  so  in  this  case  X  will 


be  conditionally  regenerative  at  s.  Since  the  invariant  d-field 
is  independent  of  s,  we  may  conclude,  in  the  context  of  recurrent 
processes  in  countable  state  spaces,  that  X  is  mixed  Markov  when¬ 
ever  H ( {s}  / (sj )  holds  for  every  state  s.  This  is  essentially  the 
characterization  of  local  homogeneity  mentioned  above. 

It  may  seem  unsatisfactory  to  have  different  descriptions  of 
the  behavior  in  the  regular  and  singular  parts  of  B.  In  Theorem  4, 
it  \i7ill  be  shown  that  (EM)  is  conditionally  true  in  the  entire  B, 
given  some  suitable  invariant  cT-field.  Unfortunately,  the  associated 
transition  kernel  will  typically  depend  on  the  choice  of  conditioning 
cT-field  in  this  case,  and  there  seems  to  be  no  natural  choice  of 
the  latter.  Furthermore,  it  is  no  longer  clear,  in  general,  whether 
X  can  be  obtained  as  a  mixture  of  regenerative  processes. 

As  for  the  organization  of  the  paper,  precise  statements  of 
the  four  main  results  described  above  will  be  given  in  the  next 
section,  with  the  appropriate  framework  duly  specified.  The 
proofs  vail  then  be  given  in  Sections  3-7.  Finally,  we  give  in 
Section  8  a  simple  example,  designed  to  illustrate  the  various 
complications  which  may  arise. 
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2i_y§ig_£§sgltSi  Throughout  the  paper,  we  shall  consider  a 
fixed  random  process  X,  defined  on  some  complete  probability 
space  (-h.,?,?)  .  The  paths  of  X  are  assumed  to  lie  in  the  space 
D=D(R^,S)  of  right-continuous  functions  w:  — ►  S  with  left-hand 

limits  on  (0,») .  Here  S  is  taken  to  be  a  separable  metric  space, 
and  for  the  last  two  theorems  we  shall  even  assume  that  S  is 
complete . 

The  o-field  in  S  is  taken  to  be  the  Borel  field  f,  while  D 
is  endowed  with  the  cf-field  ^  generated  by  the  one-dimensional 
projections  71^;  w  — >  w^  from  D  to  S.  The  process  X  is  assumed 
to  be  adapted  to  som.e  right-continuous  filtration  f ,  such 

that  T-q  contains  all  P-null  sets  of  T. 

As  in  Section  1,  we  shall  consider  some  fixed  closed  and 
recurrent  set  PCS  and  some  Borel  set  BcF,  and  we  shall  assume 
that  condition  H(F,B)  is  fulfilled.  Here  the  shift  operators  ©^, 
t>0,  on  D  are  defined  by 

(etW)g  =  '^s+t'  s,t>0,  weD, 

and  Q*  is  assumed  to  be  a  normal  probability  kernel  from  S  to  D, 
where  normal  means  that 

Q^^weO:  Wq=x}  =  1,  x€S.  (2.1) 

Note  that  ©  ‘X  is  measurable  for  every  stopping  time  T,  and  that 

t' . . . 

the ;-recurrence  relation  (1.1)  defines  a  measurable  event.  Standard 
fac|:s  like  these  will  usually  be  stated  without  proofs,  if  mentioned 

I 

at  kll_,  and*  we  refer  to  Dellacherie  and  Meyer  [4]  for  details. 

; A  basic  role  in  the  sequel  will  be  played  by  the  D-set 
r -  “A  -  (w;  w^es)^  n  |W;  w^^^WqI  U  F^j, 

consisting  of  those  paths  which  start  in  B  and  whose  excursions 
from,  the  starting  point  lie  entirely  outside  F.  In  terms  of  A,  we  may 
now  define  the  regular--' and  singular  parts  of  B  as 


5 


=  {x6B:  Q^A=Oj  ,  =  (x€-B;  O^A=l}  . 

it  it 

since  A^=D\A  belongs  to  Souslin  S) ,  we  have  A^S  ,  while  » 

where  the  star  indicates  universal  completion.  In  particular  cases, 
such  as  when  F=S,  we  have  AeS  and  hence  B  ,B  ti,  which  simplifies 

IT  S 

some  of  the  arguments  below.  Note,  however,  that  A'eS'  need  not  be 
true  in  general  (cf.  Dellacherie  [3]). 

We  proceed  to  state  our  first  main  result,  which  will  play  a 
key  role  throughout  the  paper.  Here  we  show  that  the  set  Bx(B^UBg) 
is  thin,  in  the  sense  that  lies  a.s.  outside  that  set  for  everv 
stopping  time  T.  The  sets  V7here  hits  B  or  B  respectively  will 

Jm  S 

further  be  characteri2ed  directly  in  terms  of  the  sample  paths 

of  X,  without  reference  to  the  kernel  Q.  Finally  we  show  that  B^ 

is  equivalent,  from  the  point  of  view  of  hitting  at  stopping 

times,  to  a  Borel  set  B',  and  we  describe,  in  terms  of  the  sample 

s 

paths  of  X,  the  random  set 

M  .  lt>0, 

which  will  play  such  an  important  role  in  the  subsequent  proofs. 

For  technical  reasons,  we  shall  allow  the  stopping  times  to 
take  infinite  values.  For  an  appropriate  interpretation  in  that 
case,  let  us  introduce  an  auxiliary  coffin  state  5,  and  define 
X  =  <'■  and  0  ’  X=  <?. 

OO  — 

THEOREM  1 .  For  every  stopping  time  T,  we  have 

{e^‘XtA}  =  =  {X^^BXB^}  a.s.  (2.2) 

Moreover,  there  exists  a  Borel  set  B'cB^,  such  that 

|t>0:  e^«-X€A}  :=  \t>0:  X^€-B^  J  a.s.  (2.3) 

Here  are  some  consequences  of  a  technical  nature  which  will  be 
useful  below: 


COROLLARY.  The  random  set  M  is  optional.  Moreover,  M  is  a.s, 


right-closed  and  either  empty  or  unbounded.  Finally »  we  have  for 


every  stooping  time  T 


At  this  point,  one  might  try  to  simplify  the  setting  by 


redefining  Q  on  the  set  such  as  to  make  Q  A=0  hold 


for  all  xeB\B'.  However,  this  would  lead  to  new  comolications , 
s 


in  general,  since  the  altered  version  of  0  may  not  be  measurable 
with  respect  to  /. 


The  next  result  shows  that  X  is  regenerative  at  visits  to  E^. 


If  F=S,  then  X  is  a.s.  absorbed  when  it  first  hits  B',  and  the 

s 


regenerative  property  extends  to  the  entire  B.  In  the  particular 


case  when  even  B=S,  X  is  then  a  strong  f^arkov  process.  This  is 


the  result  alluded  to  in  [6],  and  proved  for  discrete  time 
already  in  [5J. 


THEOREM  2.  Condition  (SM)  holds  a.s.  in  for  everj 

stopping  time  “Z .  ^  F=S,  the  validity  extends  to 


The  second  statement  will  be  slightly  improved  below.  However, 


it  is  generally  impossible  to  extend  the  regencracy  of  X  to  the 


whole  of  B,  as  will  be  seen  from  Example  1  in  Section  8. 


As  noted  above,  X  becomes  Markov  with  transition  kernel  Q, 


when  B=F=S.  Though  the  original  Q  need  not  satisfy  the  Chapman- 


Kolmogorov  identity,  as  required  in  the  standard  axiomatic  setup. 


it  can  be  modified  to  do  so  under  broad  conditions,  as  shown  by 


Walsh  [7] . 


For  the  remaining  results,  the  state  space  S  will  be  assumed 


to  be  complete,  and  hence  Polish.  Then  so  is  D  in  the  Skorohod- 


Stone  topology,  which  ensures  the  existence  of  regular  conditional 


distributions  for  X. 


Before  stating  the  next  main  result,  we  shall  need  to  introduce 


some  further  notation.  Let  us  first  define  the  hitting  time  for 


z (w)  =  infjt^O;  wtD, 

and  put  f=z>.X.  Then  $  is  a  stopping  time,  so  is  a  random  variable, 
and  we  may  define  the  measure 

u  =  P^X^t',  (2.4) 

and  the  associated  Q-mixture 
=J0  u(dx)  =  F,[Q 

where  F,[';C]  denotes  P-inteqration  over  the  set  C.  Introducing  the 


shift  invariant  <5-field  7"  in  D,  given  by 

*  -1 


J  =  ;  ©t  ' 

we  may  next  define  the  conditional  distribution  as  the 


Q^-a.e.  unique  probability  kernel  from  (D,7)  to  (D,£))  ,  satisfying 


J  O^i  ‘  /  jJdoH  =  ( .  o  I)  ,  le 7. 


Apart  from,  the  shift  operators  0^,  we  shall  also  need  the 


(k 


killing  operators  k^,  given  for  0;tt^3o  by 

s<.t, 
s>t . 

Note  that  the  mappings  k^  and  TT^  make  sense  even  when  t  is  a  function 
of  w.  In  particular. 


....  ■  /;;■ 


TT  w  =  w*z  (w)  ,  w€D. 

Z 

By  )  and  <T(k  )  we  shall  mean  the  cf-fields  in  D  generated  by  the 

z  z 

mappings  7  and  k  respectively.  A  relation  between  o-fields  of 
z  z 

the  form  (S’ -r  (s'  a.e.  m  means  that  ^  lies  in  the  m-completion  of  6’', 
and  similarly,  a.e.  m  means  that  t  and  C,'  have  the  same  m- 

completion . 

The  process  X  is  said  to  be  conditionally  regenerative  in  a 
certain  set,  if  X  is  regenerative  in  the  set  under  almost  every 
conditional  law.  Since  the  set  of  all  stopping  times  is  usually 


Xr 

P^e^'Xc*,  X^eBj  =  E  Q  |w;  WC',  WqC-B}  . 

Combining  this  with  Theorem  2,  we  may  conclude  that  the  process 
X  is  strong  Markov,  iff 
P]e^.X€.}  =  E  Q 

for  every  finite  stopping  time  T,  The  latter  condition  m.ay  be 
easier  to  verify  in  specific  situations. 

For  a  final  remark,  note  that  the  local  homogeneity  of  [5j  was 
defined  v/ithout  reference  to  any  specific  kernel.  In  the  same  vein, 
one  may  try  to  replace  H{F,B)  by  a  weaker  condition  H'(F,B),  stating 
that  X  is  recurrent  in  F  and  satisfies 

p!"©  “X€-/x  ©dx]  =  P  r©^»X€  '  I  X^edxl  ,  xcB  a.e.  u.a.u_, 
for  every  pair  of  stopping  times  o*  and  t,  such  that  X^,X^eF  a.s. 

(Here  '•  y,  denotes  the  largest  measure  dominated  by  both  and  p,.) 
In  the  special  case  when  F=S,  we  have  the  follov/ing  analog  of 
Theorem  2 : 

THEOREM  2'.  Condition  H’(S,B)  implies  that  (Cl)  holds  a.s.  on 
{X^feBj  for  every  stopping  time  r. 

To  prove  this,  one  needs  to  go  through  the  proofs  of  Theorem  2 
and  of  the  first  half  of  Theorem  1,  to  make  sure  that  the  stopping 
times  reouired  to  prove  the  assertions  for  a  fixed  T  may  be 
(randomly)  selected  from  some  countable  family  { T j ] •  One  may  then 

construct  a  kernel  0  such  that  (H)  holds  a.s.  in  B  for  each  T. , 

J 

and  then  proceed  as  before.  The  details  of  the  argument  are  omitted 
here. 

In  the  same  way,  one  may  prove  an  analog  of  Theorem  2  for 
arbitrary  F,  though  the  definition  of  B^  will  now  depend  on  T,  in 
general.  As  for  the  last  two  main  results,  a  stumbling  block  seems 
to  be  the  second  half  of  Theorem  1,  whose  proof  uses  stopping  times 
depending  in  a  on-constructive  manner  on  the  kernel  0.  We  do  not 
know  how  to  get  around  this  difficulty. 
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3^_Proof_of_5heorgm_l^  Our  plan  is  to  prove  (2.2),  first  for 
stopping  times  T  with  X^frF  a.s.  and  then  in  general.  We  shall  next 
discuss  the  existence  of  and  prove  from  (2.2)  that  the  two  sets 
in  (2.3)  are  indistinguishable.  From  this  the  Corollary  will  follow 
easily. 


PROOF  OF  (2.2) .  Fix  an  arbitrary  stopping  time  T  with  X^eF  a.s. 
Our  first  aim  is  to  prove  that 

(x^e-Bs}  c  xeA}  c{x^eB\E^}  a.s.  (3.i) 

To  see  this,  conclude  from  (H)  on  .^X^tBj.  and  from  the  definitions 


of  B  and  B  that 
r  s 


and 


=  e[o  ^A;  0  ^A=0j 

T  ^ 

X_  X_ 

]  =  e[q  a"";  Q  ’'a= 

The  a.s.  inclusions  in  (3.1)  follow  immediately  from  these  relations 

and  from  the  definition  of  A. 

Suppose  that  we  can  prove  the  reverse  relation 

{\^”s}  ^  a.s.  (3.2) 

Using  (H) ,  (2.1)  and  the  definitions  of  A  and  B  ,  we  then  obtain 

s 

e[q  A;  Q  A<lJ  =  e[o  A;  X^^B\BgJ  =  Pje^*XeA,  X^tENB^J 

which  shows  that  0  A=0  a.s.  on  {o  A<lJ.  By  the  definitions  of 

B^  and  B^,  we  get 


C  a.s., 

or  for  the  corresponding  differences  from  |X,jje-B^, 

(V®s}  ^  {MSNBJ  a.s. 

Thus  the  three  events  in  (3.1)  are  a.s.  eaual,  and  (2.2)  follows. 

To  complete  the  proof  of  (2.2)  when  X^tF  a.s.,  it  remains  to 
prove  (3.2).  Let  us  denote  the  metric  in  S  by  p,  and  fix  an 
arbitrary  €>0.  VJe  shall  first  need  to  show  that 
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P^e^.XjiA,  X^tB,  sup|p(X^,X^)  ;  t6[r,(T],  (3.3) 

for  sufficiently  small  constants  5>0  and  larqe  stopping  times 

o>T  with  X  tF  a.s.  To  this  aim,  note  that 
—  cr 

sup^^(X^,X^)  ;  t>T,  X^eF|s>0  on  X)£A,  X^b| 

by  the  definition  of  A,  and  conclude  that 

p{e^‘X|iA,  X^€-B,  supjp(X^,X^)  ;  te[T,T*.sJ,  X^tF)  c  5  }  ^  g 
for  all  sufficiently  large  s>0  and  small  5>0.  Formula  (3.3)  follows 
from  this  if  we  replace  s  by  the  stopping  time  cJ=inf^t>Xvs:  X^€-F|., 
and  it  remains  to  verify  that  X^tF  a.s.  But  this  is  obvious  by  the 
recurrence  of  F  and  the  facts  that  F  is  closed  while  X  is  right- 
continuous  . 

Returning  to  the  proof  of  (3.2),  we  shall  introduce  a  countable 


collection  of  auxiliary  stopping  times  T ^ ,  as  follows.  First  we 
partition  B  into  countably  many  disjoint  Borel  sets  B^  with 
diameters  )B^j<  <5",  which  is  possible  by  the  separability  of  S.  We 
then  define,  for  every  index  j,  an  associated  stopping  time 


'inf{tt  p(X<j.,X^)>/,  x^eF} 

r 


when  X  eB  . , 
3 

otherwise . 


(Here  and  below,  the  infimum  of  an  empty  subset  of  ["^rcrj  is  taken 
to  be  (7.)  Note  that  X^  tF  a.s.  Since  |Bj|<<r  while  X  is  right- 
continuous,  it  is  easy  to  check  that 


{x^€-BjJ  c  {x.^.«Bj,  sup|j?(x^,x^)  ;  X^eF}  c  j- 

From  the  definitions  of  Tj  and  A,  we  further  get  the  relations 
XfcA}  c  •  XeA  j.  a.s., 

je^.xfA,  c  (x^  =x_^=x^j.  a.s. 

Applying  (H)  to  the  stopping  times  Tj  and  using  formulas 


(3.4) 

(3.5) 

(3.6) 


(3.3)-(3.6),  we  obtain 


e[o  a^;  e^oxich]  =  2  e[o  e^*X6A, 

<  I  e[g  ^A^;  X  eB  J  =  I  p{©  .XJ^A,  X  feB.l 
j  j  ^  j  j  j  ■'■’ 

^  I  p{Q^*X)£A,  X^^By  Sup|p(X^,X^)  ;  t€:Cr,crJ,  X^feF}  <  J } 

=  Pje^tXj^A,  X^tB,  supjp(X^,X^)  ;  te  X^tF}cS}-<  £. 

Since  E  was  arbitrary,  the  left-hand  side  must  be  zero,  so  we  get 

X^ 

^©^•X€A}c  |o  A^=0j.  *  {x^€-Bg|  a.s., 

which  is  relation  (3.2).  This  completes  the  proof  of  (2.2)  under 
the  condition  X^eF  a.s. 

To  extend  (2.2)  to  arbitrary  stopping  tim.es,  let  us  first 
assume  that  'Z  is  a.s.  finite.  Then  (2.2)  applies  to  the  stopping 
time  c5=inf|t>T:  X^tFj-  since  X^tF  a.s.,  and  it  will  then  follow 
for  'T  if  we  intersect  by  .^X.j.eF|=^T=cJJ. .  If  T  is  allowed  to  be 
infinite,  we  may  apply  (2.4)  to  the  truncated  stopping  time  Tah 
and  then  intersect  by  ^'T<n]-=^T=T  An],  to  obtain 

j[e^«  XtA,  T<n}  =  (x^eBg,  T<^n}  =  {x^^B\B^,  T<nJ  a.s. 

From  this  we  obtain  (2.2)  by  letting  n-y*«». 

We  proceed  to  prove  the  second  statement  of  Theorem  1 .  Since 
this  part  will  not  be  needed  for  Theorem  2,  the  reader  may  skip 
the  proof  for  the  moment,  and  return  to  it  in  connection  with 
Theorem.  3 . 

As  a  first  step,  we  shall  prove  the  existence  of  a  Borel  set 

B'CB  ,  such  that  (2.2)  remains  true  with  B„  replaced  by  B',  i.e. 
s  s  s  s 

such  that 

(e^‘X*A}  =  {x^€-b;J  a.s.  (3 

for  every  stopping  time  T. 

PROOF  OF  EXISTENCE  OF  B^.  Our  proof  will  make  use  of  the 
measure  u  introduced  in  (2.4).  However,  that  definition  uses 


the  set  Bg/  so  we  shall  need  a  direct  way  of  construction.  For 


each  nCN  we  then  introduce  the  stopping  time  'T^=inf^t>n:  , 

and  define  a  measure  on  S  by 

‘n  ‘^n 

The  sequence  is  increasing  and  bounded,  since  the  events  on 

the  right  of  (3.8)  are  increasing  in  n,  by  the  definition  of  A  and 
the  recurrence  of  F.  The  measure  p  may  now  be  defined  by 


ce  /. 

Let  us  now  consider  an  arbitrary  stopping  time  T,  and  conclude 


jiC  =  sup  ji^C, 


as  above  that,  for  all  n^N  and  C^f, 

X^tC,  T<nJ.  e  ‘  XfcA,  ec|  a.s. 

Hence 

p(e^*xeA,  x^ec,  T<n}  <,  Yjf  1  |iC. 

Letting  n-^  oo  and  using  (2.2),  we  get 

p{x^<rBgnC}  =  P^e^^X«A,  c  pC.  (3.9) 

Since  B  € there  exists  some  Borel  set  B'cB  satisfying 
|i(Bg\B^)=0.  Applying  (3.9)  with  0=8^^^,  we  obtain 

=  0, 

and  (3.7)  follows  by  combination  with  (2.2).  ^ 

To  complete  the  proof  of  Theorem  1,  we  have  to  strengthen  (3.7) 
by  proving  that  the  two  random  sets 

Ml  =  (t>0:  e^oX^iA]-,  M2  =  {t?0:  X^tB^  | 

are  indistinguishable.  If  M^  were  known  at  the  outset  to  be  optional 
then  this  would  follow  directly  from  the  optional  section  theorem. 
But  the  optionality  of  is  in  fact  a  rather  surprising  consequence 
of  our  theorem. 

PROOF  OF  (2.3)  .  Write  and  D2  for  the  debuts  of  the  two  sets 
Mj^  and  M2.  We  shall  first  show  that  M^  and  M2  are  indistinguishable 
within  the  random  interval  (Dj^,a»)  .  Let  us  then  fix  an  arbitrary 


!»l 


❖ 


n 


m 


number  r>0,  and  introduce  the  stopping  time  T=inf|t>r:  X^tF^.  By 


the  definition  of  A,  we  have 


T  =  infit>r:  0^*XeA^  on  ^D2^<rJ.. 

Since  the  right-continuity  of  X  implies  that  is  right-closed, 


(for  a  detailed  argument,  see  the  proof  of  the  Corollary  below) , 


we  may  conclude  that  0^“XeA  on  {D^<rj..  But  then  (3.7)  yields 
X^feBg  a.s.  on  .^D^<r^,  and  it  follows  by  the  definition  of  A  that 

and  M2  are  indistinguishable  in  the  random  interval  CT,«!>)x^Dj^<r|  . 


Since  both  sets  vanish  in  [r,T)  by  the  definition  of  T,  they  must 
in  fact  agree  a.s.  in  [r ,ao)A  J-.  Hence  they  agree  a.s.  in  the 


countable  union 


U  ([r  ,«o)  y  ^Dj^<r})  =  (D^,»o)  , 


as  asserted. 


To  extend  this  result  to  [Dj^,oo)  ,  note  that  since 


is  right-closed.  Using  the  definition  of  A,  we  obtain 


=  Xj^^,  t€M^  n  (Dj,oo)  , 


and  since  and  M2  agree  a.s.  on  (D^,oo)  ,  we  may  conclude  that 
Xj^  €B^  a.s.  on  ^M^^  n  (D^  ,*«>)  . 

But  here  the  set  on  the  right  is  equivalent  to  by  the 

recurrence  of  F,  and  it  follows  that  a.s.  Thus  and  M2 

are  indeed  indistinguishable  on  fD^,Po)  . 

It  remains  to  prove  that  D2>Dj  a.s.  To  this  aim,  let 
Mg  =  M2  n  [D2,D2+e)  ,  t>0, 

and  note  that  Mg  is  optional  for  each  E.  The  optional  section  theorem 
(cf .  [4])  then  applies  and  yields  the  existence,  for  each  5>0,  of  a 


stopping  time  T  satisfying 


c-  Mg, 


p^T=«9,  D2<>»j-^<r. 


By  (3.7)  and  the  definition  of  M- ,  we  get  a.s, 


{^<0^}  =  T4iD2+e}  =  {e.p‘‘X*A,r<  D2+E}c  {D^<D2+E<eo}, 


and  hence 


P|D2<«}^  p{r<-o>  +  ^  <  p{Dj<D2+e<»^>  S, 

Since  S  was  arbitrary,  it  follows  that 

|^D2  <  »}  c  {  a  •  s .  » 

and  since  even  f  was  arbitrary,  we  get  ^2 

remains  to  notice  that  Dj^<D2  is  trivially  true  on  {^2~^}  *  ^ 

PROOF  OF  THE  COROLLARY.  The  set  M  is  optional,  since  X  is 

right-continuous  while  is  Borel .  The  last  assertion  follows 

immediately  from  (2.2)  and  (2.3).  It  remains  to  prove  that  M  is 

a.s.  right-closed  and  either  empty  or  unbounded.  By  (2.3),  it  is 

equivalent  to  prove  these  assertions  for  the  set  M'  =  ^t^0;  ©^«-XeA].. 

Let  us  then  fix  an  kJ€^,  and  let  t^^, t2,  . .  .€-M'=M' (->)  with  t^|t. 

Then  X.  =X  =...=X  by  the  definition  of  A  and  the  right-continuity 
^1  ^2  ^ 

of  X,  and  this  is  the  only  state  in  F  which  is  visited  after  t. 

Thus  0^»  X€A,  so  ttW.  This  proves  that  M'  is  right-closed. 

Let  us  next  fix  an  <4/6  A,  such  that  while  F  is  recurrent. 

If  tf.eM',  then  X,  eB,  and  this  is  the  only  state  in  F  visited 
after  t_.  Thus  X  must  be  visited  again  for  arbitrarily  large  t, 
and  any  such  t  lies  in  M'  by  definition.  This  proves  that  M'  is 
unbounded .  Q 


rw 
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ii_££QQ|_Qf_SbgQE§g_g^  Here  we  shall  first  prove  the  strong 

Markov  property  (SM)  in  when  F  is  an  arbitrary  closed  subset 

of  S.  As  before,  it  will  then  be  useful  to  consider  the  case  of 

stopping  times  T  with  X^eF  a.s.,  before  we  turn  to  the  general 

case.  Next  we  shall  assume  that  F=S,  and  prove  in  this  case  that 

(SM)  remains  true  in  B  .  In  view  of  Theorem  1,  this  will  yield 

s 

the  desired  extension  to  B. 

PROOF  OF  (SM)  IN  Assume  first  that  T  is  a  stopping  time 

with  X^eF  a.s.  It  is  required  to  show  that 

r 

pTe^^Xe.;  Cj  =  e[q  ;  cj  (4.1) 

for  any  set  Ct  ^  .  For  convenience,  we  shall  prove  instead 

that  (4.1)  holds  for  any  with 

(x^feBNBj,}  C  C  C  {x^eB}.  (4.2) 

This  will  prove  the  original  statement,  since  any  set  Ce  O  (x_^eB^]. 
may  be  written  as  a  difference 

C  =  (C  u(x^eB\Bj,})  \{x^eB\Bj.} 
between  sets  in  the  latter  class. 

As  in  the  preceding  proof,  we  shall  apply  condition  (H)  to  a 
sequence  of  auxiliary  stopping  times  Tj  •  As  before,  we  fix  an 
arbitrary  €>0,  and  choose  S>Q  and  such  that  (3.3)  is  fulfilled. 
We  shall  also  need  a  countable  partition  of  B  into  disjoint  Borel 
sets  B^  with  |Bj|  <  The  stopping  times  required  in  the  present 
proof  are  then  given  by 

r  inf  {te  j>(X^,X^)>^,  X^ePj-  on  o{x^€-Bj/ , 

^  Lt  on  Cu{x^f^Bj}. 

Recalling  the  definition  of  cf  and  the  convention  about  empty  sets, 
it  is  seen  that  X^  tF  a.s.,  so  (H)  applies  to  each  T ^ .  Note  also 
that,  instead  of  (3.4) , 
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|x^  c  [x^eE,  sup|p(x^,x^)  ;  t€[T,(r],  X^eF}c-J}.  (4.3) 

We  may  now  conclude  from  (H) ,  (3.3),  (4.2)  (4.3)  and  the 

definition  of  Tj  that 

|p[e^«X6-;  C]-e[q  C]  |  <  1  jp.  [l(e^*  XG  -Q  X^eB^  ,  c]j 


II 

M 

lEri(e^  t 

'X€.} 

1 

O 

X 

;  X  eB  . 

j 

>  L  1  -T. 

3 

J 

=  I 

j 

3 

xe  •} 

X 

-Q 

<  1 

j 

p{e^^x0A. 

-  X^GB., 

sup|^(X.^, 

=  pj 

'e^‘X0A,  x^eB, 

sup(|>(X^,X^) 

Since  £  was  arbitrary,  the  difference  on  the  left  must  vanish,  as 
asserted  in  (4,1).  This  proves  (EM)  in  B^  for  stopping  times  T  with 
X_eF  a.s. 

c 

We  next  consider  an  arbitrary  finite  stopping  time  T,  and  a 

set  CG  3^  A  .  Putting  (J=inf{t>T:  X^gfJ  as  before,  we  get 

X_eF  a.s.,  and  it  is  further  seen  that 
o 

c  G  n{T=cr,  X^GB^].  (4.4) 

Thus  (4.1)  holds  with  O'  in  place  of  T,  and  we  get  in  view  of  (4.4) 

X  X^ 

pfe^^xe-;  Cj  =  c]  =  e[q  c]  =  e[Q  ;  cj  , 

as  desired. 

For  general  T,  let  again  n|X^tB^| ,  and  note  that 

C^{T±n}  =  C  n  {T  =  TAn}  € 

(cf.  [4]  ) ,  and  that  moreover 

c  ''(Tin}  r.  {X^eB^,  Tin}  c  {Vn«r}- 
Hence  (4.1)  applies  with  T  and  C  replaced  by  T^n  and  Cn(T£nJ.,  and 
we  get 

X 

p[g^«X€',  T<n;  cJ  =  T^n;  c]  =  e[o  r<n,  c] 

Xt 

=  e[0  ;  T*n,  c] . 


i*  h  **• 
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5i_Some_auxiliarY_results^  In  this  section  we  shall  collect 


soine  auxiliary  results,  needed  for  the  proofs  of  the  last  two 
main  theorems.  We  shall  also  introduce  the  stopping  times  . 

and  the  associated  excursions  which  will  later  play  a 

basic  role.  The  only  result  in  this  section  which  may  be  of  some 
independent  interest  is  Lemma  5.6  on  exchangeable  sequences. 

Our  first  aim  is  to  restate  the  homogeneity  condition  (H)  for 
visits  to  B'  in  terms  of  the  mixture  Q^.  In  the  proof,  we  shall  make 
use  of  the  optional  set  M=^t>0;  ,  introduced  in  Section  2. 

LEMMA  5.1.  Let  T  be  a  stopping  time  satisfying  a . s . 

on  Then 

P{e^i  X€' ,  (5.1) 

and 

^[e^.xe.|x"^7j  =  Q^M7]  *X  a . s .  on  .  (5.2) 

PROOF.  To  prove  (5.1),  let  us  introduce  the  auxiliary  stopping 


times 


=  inf{t>rAn:  neN, 


and  note  that  X  a.s.  for  each  n.  Fence  (H)  applies  to  each  T  , 
T  ^  -  n 

n 

and  we  get 


p{e^  ‘X« •,  j  •  e[q 

n  n  n 


(5.3) 


Now  both  X  eB’  and  X  ^B '  imply  t<»,  and  on  the  same  set  T  =T  for 
r  s  s  ^  '  n 

n 

all  sufficiently  large  n.  Letting  n->«e  in  (5.3),  we  thus  obtain 


v^q^oXk-  ,^<oo}  =  p{e^‘Xe',  x^eB^j. 

X..  X^.  (5.4) 

=  e[q  ;  =  e[q 

Next  conclude  from  (2.3)  that  ‘  XrA  a.s.  on  and  that 

moreover  ^=inf|t>0:  ©^cX^aJ.  a.s.  Since  the  latter  set  is  right- 
closed,  it  follows  that  even  ©^«XfeA  a.s.  on  Using  the 

definition  of  A  we  thus  obtain  X^=X^  a.s.  on  and  so,  by  the 
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definition  of  u. 


Xu 

e[q  ;  =  e[q  ^<0o]  =JC'^jd(dx)  =  qP. 

Combining  this  with  (5.4)  yields  (5.1). 

To  prove  (5.2),  note  that  {^<«oJa.s.  equals  unbounded}  ex  ^7. 
For  any  TeJ  with  {xei}c{M  unbounded},  we  get  by  (5.1) 

P{e^oX€',  Xfel}  =  Pje^i-X^  .  d  I,  {-cpej.  =  qH(  .  q  I)  =  Jq^[.  |7]dQ^ 


=  f  0'^[*|7j  dPx“^  =  J  0^[>l7]*  X  dP, 

{Xei} 


as  desired. 


We  proceed  to  discuss  some  properties  of  the  random  set  M. 


Recall  from  the  Corollary  to  Theorem  1  that  M  is  a.s.  right-closed 


and  either  empty  or  unbounded.  We  shall  also  need  some  information 


about  the  gaps  of  M.  By  a  gap  we  mean  an  open  interval  (a,b) ,  such 


that  (a,b)OM=j3  while  a,b6M,  where  M  denotes  the  closure  of  M.  Note 


that  the  gaps  of  M  are  disjoint. 


LEMMA  5.2.  For  any  fixed  h>0 ,  the  random  set  M  has  a.s.  either 


none  or  infinitely  many  gaps  >h. 


’^'ROOF.  Applying  Lemma  5.1  to  the  stopping  times 


=  inf|^t>n;  teM},  n€Z^, 


we  get 


p|m  has  gaps  :^h}  =  pIm  has  gaps  ^  h  in  [n,^)} 


=  P  n  [m  has  gaps  >h  in  [n /><>)} 
n=0 


=  p|m  has  infinitely  many  gaps 


Since  the  event  on  the  right  implies  the  one  on  the  left,  the  two 


must  be  a.s.  equal.  Thus  the  possibility  of  finitely  many  gaps  >h 


is  a.s.  excluded. 


Combining  this  result  with  Theorem  1,  it  is  seen  that  with 


probability  one  either  M=^C,«o)  for  some  or  M  has  infinitely 

many  gaps  greater  than  some  h->0.  It  is  convenient  to  state  a 
corresponding  fact  in  terms  of  suitable  invariant  sets  in  D.  Let 
us  then  introduce  the  set-valued  function 
m(w)  =  {t>0:  weD, 

and  define  the  “y-sets 


lA  =  U  m^e  w=  [t,^))^  , 

^  t  >0  ^  ■' 

Ij*  =  r)  iweD:  m.c  ©  w  has  gaps  >h|,  h>-0, 

"  t>0'’  ^ 


^h  = 


h  >0; 


^0  = 


In  this  notation,  we  have  with  probability  one  either  M=f5  or  Xtl^. 

An  important  role  in  the  sequel  will  be  played  by  the  stopping 
times  ^o'^l'"**  processes  defined  for  fixed  h  >  0  by 


3=  <  ;  =  inf  {t^r^_^+ht  teM],  neN, 


y„(t)  . 


1 


ntN. 


Note  that  the  sample  paths  of  ¥^,¥2,...  lie  in  the  space  D^=D{R^,S^) 
v/here  is  obtained  from  S  by  attaching  3  as  an  isolated  point. 

Let  us  write  Y  for  the  random  element  .  .  .)  of  .  In 

the  latter  space,  the  discrete  shift  operators  are  given  by 

®(y2^/y2'  •  *  •)~(y2^y3^  •  * ^  ^n~^  * 

We  shall  need  to  construct  universally  measurable  mappings  ^  and  v^i, 
satisfying  •j'‘X=Y  and  '^<'Y=0^‘-X,  and  commuting  in  a  suitable  sense 
with  the  shift  operators  on  D  and  D^. 

Let  us  then  define  the  functions  tQ,tj^,...  and  .  .  .  on  D, 

in  the  same  way  as  and  ¥^,¥2,...  were  defined  in  terms  of 

X.  More  [irtv i  sol  y ,  l»>t 


tQ  =  z  =  inf  m, 


d  =  inf|s^h; 


t 


t..  T  +  d»©^ 


neN. 


and  put ,  Y2  f  •  •  • )  •  ■^11  these  functions  are  clearly  2>*-ineasurable 
To  construct  a  napping  in  the  opposite  direction,  let 
d  '  (w)  =  inf|t>0:  w^=3j',  wtDj  , 
and  define  for  y=  »y2  /  •  •  • ) 

r^(y)  =  d'(y^)  +  ...  +  d'(y^),  nez_|_, 

t5^sup  r^. 


(^i'(y)  ) 


l3. 


LEMI4A  5.3.  The  above  functions  are  universally  measurable  and 
satisfy 

i  ®t  "  ®n  ^ 

n 

'1  =  (©J,  ’f)‘Y  =  ®t  '  (5.8 

n  n 

Moreover,  there  exist  universally  measurable  functions  n^,n^:  — ►  Z 

t>0 /  such  that 

©  v  If  =  e  , ;  ?  6©.  on  I,  ,  t>0.  (5.9) 

n^  I  n^  1  t  —  h  — 


inf -is+t^h+t :  s+ttm^ 
inf|s>h+t:  s6mj. 


z>©.  =0  on  the  set  •lt^<«}. 

t  I  n 

n 

More  generally,  it  is  seen  by  induction  that 

n 

Indeed,  assuming  (5.10)  to  be  true  with  k-1  instead  of  Ic,  we  get 
by  (5.5) 


PROOF .  For  every  t >0  we  have 
t  +  d"©^  =  t  +  inf^s^h:  stro*©^^ 


so 


Putting  particular 


(5.10) 


=  Vi-\  " 

n 


=  t,  ,  ,  +  dc  0, 

k-l+n  t 


k-l+n 


'k+n' 


as  desired.  Combining  (5.10)  with  (5.6)  yields 


‘*’1“  %-l' ®t  %-r  ®t  +‘n  '''^'%+n-l 

n  n 

and  (5.7)  follows. 

To  prove  (5.8),  note  that 

Vl 

and  conclude  by  summation  that 

^n^^f  =  tn  ■  ^  on  {z<<>o},  nez_|^. 

Assuming  that  z*-oo  and  t+z€  [t^_ t^)  ,  we  get 

(f»<f)t  =  Y'n^^-'^n-r?^  = 


t.  v  0.  +t 

k-1  t„  n 


'k+n-1 


(5.11) 


f  ^  =  e^,  (5.12) 

at  least  when  z<-«o.  But  then  (5.12)  must  be  generally  true,  since 
it  reduces  to  a  triviality  when  z=  k>  .  Combining  (5.12)  with  (5.7) 


and  (5.10)  yields 


vpv©.<^  =  (bc«re0  =  0  -  =0  _  =  0^ 

T  n  T  T  I  t_  Zv©.  t^  Zf©.  +t  t 


=  » 


^n  ^ 


t  n 
n 


v;hich  proves  the  equality  between  the  extreme  members  of  (5.8).  On 

the  other  hand,  we  may  use  (5.11)  and  (5.12)  to  obtain  for  z  ■«  x. 

(0  <54009  =  ©  v<L70to  =  e  oQ  =  ©,.  , 

r„  7 '  T  r-„ca)  r  T  t„-z  z  t„ ' 
n  n  T  n  n 

which  again  extends  immediately  to  arbitrary  z.  Thus  the  right 
equality  in  (5.8)  is  also  true,  and  so  the  proof  of  (5.8)  is 
com.plete . 

To  prove  (5.9)  for  suitable  n^  and  n^,  let  us  first  assum.e  that 
wtl^,  and  define 

T(w)  =  inf|s>0:  [s  ,  s+h]  o  ra  (w)  ^0}, 


“t '  ' 


'"n''  ■‘’®t 


It  I 

Note  that  T  and  are  finite  and  ©  -measurable  functions  of  w  on 


We  shall  shov;  that 

t  ^.  =  t  +  t  ^  ke2!^,  t>0. 

n^+k  np*0^+k  t  +  — 

To  see  this,  conclude  from  the  definitions  that 

t  =  infl’sfem:  s  >  Tc  0^+tj- ,  t >0  . 

“t 

Hence 


(5.13) 


®t  *  s>T.e^j 

=  inf|s^0:  s+t^m,  s+t>T“ft^+tj 
=  influem:  u^T»©^+t_^  -  t  =  t^  -  t, 

which  proves  (5.13)  for  k=0.  Combining  this  special  case  v/ith  (5.10), 
we  obtain  more  generally 

^n.+k  “  ^n.  ^k‘’®t  -  ^  +  ^n^t©  *®t  '''  ^k‘'®t+t 

t  t  n^  0  t  ^0  ®t 

=  ‘  Ve.‘®t  *  V®t„  Vs.+k-^t' 

0  t  "o'  ®t  °  " 

as  desired.  Using  (5.13),  we  get  for  k€N 


T k+n„®  9^^  ®t  ^  ^^k+n„»  ©._-l^  ^k+n„*  ©^  ^ 


‘0  t 


‘0  '"t 


0  t 


=  ""•  +"k+n^-l>  '  ’'k+n^>  =  'tk+n^' 


so  (5.9)  holds  v/ith 


n^(w)  =  nQ(©^w),  t>0. 

It  remains  to  consider  the  case  when  w^Iq.  Let  us  then  define 

T’(w)  =  inf-'s>0:  w  ©B,  ©  w-c  >, 

I  —  s  s  v/„  i 

s 

N(w)  =  infikeZ^-'  tj^  (v/)  >  T’ (w)  j.  , 

and  note  that  N  is  finite  and  S)  -measurable.  Moreover,  Wg=w^  for 
s>tj^j  while  (©^w)  g=w^  for 

^tV+k  =  ^Nce^+k'®t' 

Thus  (5.9)  holds  in  this  case  with 


n^(w)  =  ^Mw),  n^{w)  =  K(©^v;),  t>0 . 

It  is  convenient  to  restate  (5.7)  and  (5.8)  in  terms  of  X  and  Y 
COROLLARY  5.4.  For  each  ntZ^,  we  have  identically 


0  X  =  ©  !<Y, 
r  Tn  n  ' 

f  ©n‘Y  =  .X. 


(5.1 


(5.1 


Our  next  aim  is  to  relate  the  shift  invariant  cf-fields  in  D 
and  through  the  mapping  In  d",  the  invariant  tf-field  is 
given  by 

To  stress  the  dependence  of  <|>,Y,...  on  h,  we  shall  sometimes  write 
‘fh'’^h'  ••  • 


LEMMA  5,5.  For  each  h  ■>  0  we  have 

Moreover,  there  exists  some  set  such  that 

PROOF.  Let  I<:J’''‘Iq  be  arbitrary,  and  put 

JO  eo  T  , 

j  =  O  U  ©n  V 

Tn=l  n=m 

Then  clearly  Using  Lemma  5.3,  the  invariance  of  I  and  the 

finiteness  of  t^,t2,...  on  1^,  it  is  further  seen  that 


(5.1 


=  n  u{T^e;;V  1}  =  i. 

m=  1  n=iT’ 

This  proves  (5.16). 

From  (5.16)  it  follows  in  particular  that  some 

To  prove  (5.17),  it  remains  to  show  that 
c  70  1^. 

Let  us  then  consider  an  arbitrary  set  and  put  l=\^”^j.  Then 
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»4l| 


I 

I 


a 


•I? 


I 


=  (Pl\e  ■  ir^C]  )*^T  =  0  or  1  a.s., 
and  it  fo  i ows  easily  that,  a.s., 

.G  =  ^pre^^el;^'Vj  =  l;  c 

Thus  a.s.,  so  e~^7^C  a.s.  P^"^. 

To  derive  the  upper  bound  in  (5.18),  note  that  (5.19)  remains 

-1  >» 

true  with  C  =0’(  ^^)  V  ^  u.  Applyina  the  law  of  large  numbers  to 


successive  blocks  of  n  components,  we  get  a.s. 


^  •  •  •  /  ffj)  ®  *  I ^0 '  ^  ~  ^  f (  '  *  •  * »  ^  J  ^0 '  ^  ®  ' 


and  hence  also 


■»  ( ^]^ »  •  •  • »  ®  ■  I  ^  ( f], '  *  •  * '  ^  ^  ^  ' 

By  a  monotone  class  argument,  this  extends  to 

■ /Co'TVVJ, 


and  v;e  get  in  particular,  for  any  CtC*, 


I{fec}  =  pf?ec/fo,rV]  =  p|;f€c/^o,r’©"Vj  G  cy(fQ)^ 

Thus  f';:'.  a(?Qlv  €"^g“-^7  a.s.,  so  <^'c  <7(1:^)  -  e~^3"  a.s.  pT’.  Q 


.-1,.-1- 


|^_gEQQf_gf_5bgQEg^_3^  The  irain  idea  of  the  proof  is  to  show 
by  ireans  of  Theorem  2.1  in  [5j  that  the  sequence  of  excursions 
^1'^2'*‘‘  exchangeable  and  hence  conditionally  i.i.d.  This 
yields  the  conditional  form  of  the  strong  Markov  property  at  the 
random  times  Since  an  arbitrary  stopping  time  in  M  can  be 

approximated  by  times  T^,  the  general  result  follows  from  this  by  a 
continuity  argument.  Similar  arguments  were  used  on  several  occations 
already  in  [ 5 j . 

We  proceed  to  the  detailed  argument,  and  begin  with  (2.5). 

Here  it  will  be  convenient  to  consider  a  special  case  first. 

PROOF  OF  (2.5)  WHEN  A.S.  Let  ^  be  the  discrete  filtration 

associated  with  the  stopping  times  above,  i.e.  ^  for 

n 

n%Z^,  and  note  that  Y  is  adapted  to  If  O’  is  a  finite  Cj  stopping 

time,  then  T  is  an  stopping  time,  and  moreover  X_  eB*  a.s.  since 
o  T  s 

o 

M  is  right-closed.  Hence 

<y 

by  Lemra  5.1,  so  by  Corollary  5.4  we  have 

p,VV'-;  > 

independently  of  O’.  We  may  then  conclude  from  Theorem  2.1  in  LsJ 
that  Y  is  exchangeable,  and  that  indeed 

P[e^-Yt.|(j^,v^]  =  p[Yf)v^J  a.s. 

for  some  random  probability  measure  V  on  d^.  This  extends  bv  a 
standard  argument  to 

for  finite  CJ  stopping  times  o.  Noting  that 
a(p)  -  y-ij-  X-I7  a.s. 

bv  Lemmas  5.5  and  5.6,  and  using  Lemma  5.1  and  Corollary  5.4,  we 


hence  obtain 


p  e.^-x-  ;x^,  x-lM.  .,^..  ,  =  Pf,  V. 

,-l 


=  pfe.»xe  •  jx"-^7j  =  Q^[-|7j‘X. 


This  proves  (2.5)  for  stopping  times  T  of  the  form  T^. 

To  extend  this  to  arbitrary  stopping  times  T  with  X  fcB '  a.s., 

t  s 

put 

Th  =  inf^T^>r:  nfeZ^}, 

and  note  that  is  a.s.  of  the  form  for  some  ^stopping  time  o 

Thus  (2.5)  holds  with  T.  in  olace  of  T,  and  since  T  c  711  ,  we  aet 

n  ^  ‘'h 

P[e^  --Xe.;?^,  X--7J  =o^[./7j‘X  a.s. 
h 

This  clearly  remains  true  for  every  sufficiently  small  h>0. 

ITow  a.s.  as  h— *■  0  by  construction,  so  we  get 

p[x(Tj^+t)  -^X(r+t)|^,  X“^J]  =  1  a.s.,  t>0, 

by  the  right-continuity  of  paths.  Hence  the  finite-dimensional 

distributions  of  *  X  converge  weakly  to  those  of  e^oX,  a.s.  with 

1 

respect  to  P [  • ,  X  Jj .  On  the  other  hand,  these  distributions 
are  a.s.  given  by  [■  j  7]“  X.  Thus  both  sides  of  (2.5)  have  the 
sarnie  finite-dimensional  distributions,  and  since  the  latter 
determine  the  whole  distribution,  (2.5)  is  generally  true. 

Let  us  next  consider  the  case  when  T  is  an  arbitrary  finite 
stopping  time.  We  then  define  (5=inf^t>T;  and  note  that  cr 

is  a  stopping  tim.e  with  X  fcB'  a.s.,  since  M  is  a.s.  right-closed. 
Hence  (2.5)  holds  with  T  replaced  by  cr,  and  since  '^{<3'='^}  = 
^n[cy=r},  the  original  relation  must  be  a.s.  true  on  {<y=T}.  It 
remains  to  notice  that  (x^eB^ J  C  {cr=T)  by  the  definition  of  cr. 

We  finally  assume  that  T  is  an  arbitrary  stopping  time.  Then 
(2.5)  holds  with  T  replaced  by  TAn  for  any  fixed  nfcP,  and  since 
7,  (T<inl=  (T<nl ,  the  oriainal  relation  is  then  a.s.  true  on 
X^rB^,  The  assertion  for  T  now  follows  by  letting  n-*»o. 


PROOF  OF  (2.5)  IN  THE  GENERAL  CASE.  From  the  assertions  in 
Lemma  5.1,  we  get  immediately  the  corresponding  statements  for 
the  conditional  probabilities  and  =0^  (  • Ij^) /Q^I] 

provided  that  >0.  Proceeding  as  in  the  special  case  above, 

it  is  then  seen  that 

p[e^«X6.j:^,  x"^7,  XeljjJ  =  Q^^[.  )7,Ij^J»X  a.s.  on  X€lj^}, 

which  is  equivalent  to  (2.5)  on  the  set  .  Since  h  is 

arbitrary,  this  extends  immediately  to  Ix^Iq}.  It  remains  to 
notice  that  ■[x^tB^  }  c  (Xt  Iq  }  a.s.,  by  Lemma  5.2.  I. 

PROOF  OF  THE  CONDITIONAL  REGENERACY  IN  B  .  We  shall  prove  the 

s 

stronger  statement  that,  for  almost  every  conditional  distribution 
P'=P[’  jx~^7] ,  there  exists  some  probability  measure  Q'  on  D,  such 
that 

P’fe^cxt  '  on  [x,eB^},  a.s.  P’,  (6. 

for  every  stopping  time  T.  By  (2.5),  this  holds  v/ith  /JJ'-X 

for  every  fixed  stopping  time  T.  The  point  is  that  the  exceptional 
P-null  set  where  (6.1)  r.ay  fail  can  be  taken  to  be  independent  of 

To  see  this,  note  that  (6.1)  holds  simultaneously  for  the 
countable  collection  of  stopping  times  and 

outside  a  fixed  P-null  set.  For  any  P'  and  O'  with  this  property, 
we  may  now  proceed  as  above  to  extend  (6.1)  in  steps,  first  to 
stopping  times  of  the  form  with  o'  random,  then  to  stopping 

times  T  with  X-eE'  a.s.  P',  next  to  all  finite  stopping  times, 
and  finally  to  the  general  case.  Q 

From  (2.5)  follows  the  same  relation  with  X  V  in  place  of 
X  ^ 'J,  for  arbitrary  C  satisfying  (2.7),  and  (2.6)  then  follows 
by  ti{)plyint|  (2.5)  to  the  stopping  times  T  and  To  complete  the 


proof  of  Theorem  3,  it  thus  remains  to  show  that  (2.6)  for  all 
stopping  times  implies  (2.7). 

PROOF  OF  (2.7)  FROM  (2.6).  Fix  h.>0,  define  Y=  (Y^ , Y2 ,  .  .  . )  as 
before,  and  put  YQ=k^«X.  From  (2.6)  it  is  seen  that  Yj^,Y2,... 
are  conditionally  i.i.d.  and  independent  of  Y^,  a.s.  on  and 

given  the  c-field  X  Vv  o'(X^)  .  By  Lemma  5.6,  this  implies 

y“^7  c  X~V  ^  cr(x^)  c  y"^^7  V  cr(Y^j)  a.s.  on  ■  (6.2) 

In  particular  we  may  take  ^  =  J,  and  then  we  get  in  conjunction 
with  Lemma  5.5  and  Theorem  1 

x“^^c  y“^^  cx“  V  V  cr(X^)  =  x“^7  a.s.  on  . 

Thus  Y~^''=X~^7  a.s.  on  ^^<»},  and  (2.7)  follows  by  substituting 
x“^^  for  Y~^J  in  (6.2)  .  0 

PROOF  OF  THE  COROLLARY.  From  Theorems  2  and  3  it  is  seen  that 
X  is  regenerative  in  B  iff 

7  C  tf(T  )  c  7  V  0'(k,)  a.s.  Pjxe ',  .  (6.3) 

Now  rr  is  clearly  shift  invariant  on  the  set  where  ©  €-A  while  m  is 

Z  Z 

unbounded,  and  the  latter  set  has  full  measure,  since 
pje^cXtA,  M  is  unbounded]-  =  P^icsoj-, 
by  Theorem  1  and  its  corollary.  Thus 
(J('^)c7  a.s.  P{Xe-,  , 

so  (6.3)  reduces  to 

7=  (T{7r^)  a.s.  p{xe-,j<*o>. 

Using  the  definition  of  O',  we  may  rewrite  this  in  the  form 
7=  a.s.  p{e^*X€',  =  Q^. 


jV-Ti 
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2i_PfQQf_of_Th§Q£§^_li  Our  plan  is  first  to  derive  (2.8)  from 
the  three  preceding  theorems.  Our  next  step  is  to  construct  a  T- 
independent  version  of  Q  [.  jirQ/?']  from  a  product  measurable 
version  of  C*  »  where  the  latter  is  known  to  exist  when  7* 

is  countably  generated.  To  prove  the  final  assertion,  we  shall 
show  that  7"  is  equivalent  to  some  O-field  satisfying  the 
previous  requirements,  in  the  sense  of  yielding  the  same  conditional 
distributions  in  (2.8). 

PROOF  OF  (2.8).  Our  first  aim  is  to  prove  that  (2.8)  holds 
a.s.  on  for  any  stopping  time  T.  To  see  this,  fix  a  stopping 

time  L,  let  J.ej'  and  Cic/  ''  B  be  arbitrary,  and  conclude  from,  the 

^  Hr  Hr 

invariance  of  I  and  the  definitions  of  0  ^  and  O  |7rg,'7'J  that 

— 1  —  1 

Xel,  A  lO  TTq-^C}  =  O  *■  (  '  ^  I  TTq  C) 

'  I ’ll, ,  7’J  1  (I ’fo^C)  do'’’" 

Ht 

=  e[o  l>  /Tq  ,  7’J  *  X;  Xtl ,  X^ecj . 

Hence 

^fG^‘Xe-,  x^l|x^]  =  jTg,  7’7»  e.r*X;  X»rl/X^J  a.s.  on  {X^<-B^}. 

Since  (SM)  holds  in  B^  by  Theorem  2,  it  follows  that 

jTrQ,7'.]v  e^»x;  xtij?^]  a.s.  on  (x^eB^\. 

Thus  we  get,  a.s.  on  [x^tB 

p[e^^x^'|r^,  X~^7’J  =  E  /7rp,7'J‘ e..x/^,  x~h'] 

as  asserted. 

By  Theorem  1  it  rem.ains  to  prove  (2.8)  a.s.  on  {X^«-Bg|,  and 

by  Theorem  3  it  then  suffices  to  show  that 
u_ 

Q  [' a.s.  on  {X^«-Bg|.  (7.1) 

To  see  this,  note  that  X.p=Xj  a.s.  on  .  Hence  on  B^ , 


“t  u  -1 

and  therefore  O  <Q^  on  Tq  e^.  Thus  v;e  get,  by  the  hypothesis  on  J 

i  a-e-  on 

and  (7.1)  follows  by  the  definitions  of  7  and  q"  ^  . 

For  the  next  step  of  our  proof,  we  shall  need  the  following 
standard,  result  (cf.  i:4])r 

LEMM?>  7.1.  Let  P  be  a  probability  kernel  fror  a  measurable 
space  (S,/)  into  some  Polish  space  (T,T) ,  and  let  T*  be  a  countabl 
generated  suh-o'-field  of  T.  Then  IT’]  (t)  has  a  regular  and 

'j '  -measurable  version. 

We  ray  now  prove  the  second,  statement  of  the  theorem. 


PROOF  OF  THE  r-INDEPF.NDFKCE.  If  7'  is  countably  generated, 
then  Lemma  7 . 1  yields  the  existence  of  a  regular  and  product 
measurable  version  of  the  conditional  probabilities  O  ^^-  jj’]  . 
Given  any  such  version,  we  shall  prove  that 


"I'  =  0  |7’J  (w) 


a.e.  Q  , 


for  every  stopping  time  T.  Since  the  right-hand  side  is  <7{;r_)v  7’- 

Hr 

measurable,  a  T-independent  version  of  o'  £  •  jj'J  may  then  be 
defined  by  the  eauality  in  (7.2). 

To  prove  (7.2)  ,  note  first  that  E(^f)  =  (Ef)f  for  any  random, 
measure  ^  and  measurable  function  f>0  on  the  same  space.  Using 
this  fact,  along  with  the  definitions  of  O  and  Q’£’|7'J  and 


the  normality  of  Q  ,  we  get  for  arbitrary  lej'  and  Ctr  f 
U  X  X 

Q^'^(.  o  10  TT^^C)  =  E  Q  ”'’(.  o  I ->  7r"^C)  =  e[q  ;  x^ec] 

X  X 

=  F-fJo  X^e-c] 


''  -1 
loTTo^C 


Q  [•  H'J  (w)Q  ^(dw) 
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_  f 

—  t 

I 


w 

Q 


0 


(w) 


(dv;) 


f 


as  desired . 


a 


To  Drove  the  last  statement  of  the  theorem,  let  us  introduce  the 
space  M(D^->)  of  probability  measures  on  ,  and  let  .!<  be  the  cr-field 
in  M(Dj)  generated  by  the  m.appings  m— mC,  meM(D^),  for  arbitrary 

=  We  shall  need  another  standard  fact: 

LEMMA  7.2.  The  cf-f  ield  M  iji  M ( )  is  countably  generated. 

PROOF.  Note  that  is  the  Borel  cf-field  in  generated  by  the 
Skorohod-Stone  topology.  Similarly,  ►W  is  the  Borel  d’-field  in 
M(D^)  generated  by  the  topology  of  weak  convergence  for  probability 
measures  on  .  Since  S^  is  Polish,  so  is  and  hence  also  M(Dj) .  In 
particular,  M  is  then  generated  by  any  countable  base  in  M(D^).  0 


PROOF  OF  THE  LAST  STATEMENT.  Fix  positive  numbers  i  0 ,  and 


write 


•^1  == 


Jr,  = 

n  n  n_  , 
n  n-1 


n*2 , 3 , . . . , 


where  the  sets  I,  ,  h>0,  are  defined  as  in  Section  5.  Let  v  be 

n  —  n 

the  random  probability  measure  V  of  Section  6  corresponding  to 

h=h_,  and  conclude  from  the  law  of  large  numbers  that  ✓  has  a 
n  ^  n 

-measurable  version.  Since  moreover  on 

n  n 

by  Lemma  5.5,  there  exists  an  C^/,H -measurable  mapping  m  :  J  —* 

n  n 

M(D)  ,  such  that  V  =m  :X  a.s.  on  /X€J  Let  7'  be  the  cr-field 

n  n  »•  n  j 

in  D  generated  by  the  mappings  • • • 

By  construction  we  have  j'  a  7"»  and  from  Lemma  7.2  it 
follows  that  7'  is  countably  generated.  By  Lemma  5.6  it  is  further 


seen  that  X  7'=x"’  7  on  each  set  so  we  get 


(e^«x)"^.7'  =  x“^7'  =  =  {e  •X)~^7  a.s.  on  {^<^} 


-1- 


(7.3) 


and  hence  J'-J  a.e.  Q^.  Thus  7’  fulfills  the  hypotheses  of  the 
theorem,  so  (2.8)  must  hold  with  some  T-independent  version  of 

To  com.plete  the  proof,  it  suffices  to  shov/  that 

p[e^»X€'|^,  =p[e^»xe  j^,  x"'7’'J  a.s. 

Pr  Pr  Hr  1 

o'  ^  ^  ^ 

in  the  sense  that  any  version  on  the  right  is  also  a  version  on 
the  left.  Since  7” C  7' ,  it  is  then  enouah  to  show  that 

X~^7'  =  X"^7"  a.s.  (7 

and 

Hr  -1 

7'  =  7"  a.e.  0  on  ’fg  S.  (7 

Here  (7.4)  follows  from  (7.3)  and  from  the  fact  that  is  a.s 

an  atom  of  both  cr-fields.  Given  (7.4),  v/e  get  as  before 

(0  .X)"^7'  =  X"^7’  =  X”^7"  =  («  ‘X)”V'  a.s.  on{T^a»j, 
which  implies  (7.5). 


SI 


8j._Fxai!?£les^  The  main  purpose  of  the  present  section  is  to 
illustrate  the  results  of  Section  2  by  a  simple  example,  exhibiting 
most  of  the  features  of  the  general  case.  Here  we  are  choosing  the 
time  scale  to  be  discrete,  for  convenience,  but  it  is  easy  to 
construct  an  analogous  exam.ple  in  continuous  time,  by  letting  the 
transitions  between  states  occur  at  times  g  iven  by  a  homogeneous 
Poisson  process. 

Example  1.  Let  S= ^0 , 1 , . . . , 8 } ,  and  let /I  consist  of  the 
following  six  "paths"  from  Z_^  to  S: 

^=0171717...,  u;^=0383838.  .  .  ,  ^^^=0555..., 

‘^2=0272727...,  u;^=04  84848  ...  ,  u;>g=0666... 

Let  7"  be  the  discrete  cT-field  on  ri ,  and  let  be  the 

filtration  generated  by  the  identity  map  X= (X^ ,X^ , . . . )  on 
Note  that  while  7^=^=...=  /;  On  n.  we  introduce  the 

probability  measure  P,  assigning  the  same  probability  1/6  to  all 
paths . 

Using  the  fact  that  stopping  times  with  respect  to  {"7^  ate 
either  identically  zero  or  strictly  positive,  one  can  easily  shov/ 
that  H(F,B)  is  true  with  F= |0, 5 , 6 , 7 , 8}  and  B={0,7,8].  Here  Q^=P, 
while  assigns  probability  1/2  to  each  one  of  ^2*^1  ®2^2' 

and  sim.ilarly  for  Q® .  Thus  B^={0}  while  ^^=(7,8},  and  it  is 
easily  seen  that  X  regenerates  in  B^  but  not  in  B^.  This  illustrates 
the  statements  of  Theorems  1  and  2. 

Turning  to  the  statements  of  Theorem  3,  note  that  gives 
mass  1/4  to  each  of  the  paths  e2‘*^-|^ , .  . .  ,02'*^4  •  Since  these  are 
separated  by  invariant  sets,  it  follows  that  Q^['  degenerates 

at  for  j=l,...,4.  Since  moreover  X  ^7=T  in  the  present  case, 

it  is  seen  that  p['  jx  (w^)  degenerates  at  <4/  for  j=l,...,4. 

Thus  (2.5)  holds  as  asserted.  However,  the  two  equivalent  conditions 


of  the  Corollary  fail  in  the  present  case,  since  cJ(X^ )  is 
the  cy-field  generated  by  the  partition  while 
X  is  the  one  generated  by  (-^,>-^^^1  » •  •  • ,  • 

Most  interesting  in  the  present  example  is  perhaps  to  look  at 
the  statements ‘of  Theorem  4.  Since  S  is  finite,  we  can  always  choose 


w. 


Q 


(w)  =  Q"°f'!7'J(w), 


regardless  of  the  nature  of  7'.  In  particular,  (2,8)  holds  with 

Vr 

Q  as  above  for  J'=7,  but  also  for  7’  equal  to,  say, 

•  0-(Il3,l2^)  or  7^  =  0(114,123). 


where  1^^  denotes  the  set  of  paths  visiting  the  set  {i,j}  infinitely 
often.  For  the  latter,  Q  [•  l7’]  and  Q  [♦  j7'J  are  a.s.  degenerate 
as  before,  but  is  non-degenerate  for  j=l,2,  and  differs 

for  the  two  cases.  In  fact,  it  is  easily  verified  that  1 

=1/2  for  i,je(l,3^  or  i,je{2,4},  and  similarly  for  7^  with  3  and  4 
interchanged.  Note  also  that  both  7|  and  7^  locally  minimal, 
in  the  sense  that,  whenever  a  cT-field  7'  c  7j  is  such  that 
7'v'cr(~Q)  =  7  a.e.  Q‘^,  then  J'  =  7j  a.e.  Q^.  This  illustrates  the 
non-uniqueness  of  kernel  and  non-existence  of  a  minimal  conditioning 
O-field  in  the  statement  of  Theorem  4.  0 


ITe  conclude  this  section  by  correcting  an  error  in  I5J  related 
to  the  present  work.  As  part  of  Theorem  4.5  in  [5J ,  it  was  claimed 
that  a  real  valued,  continuous,  recurrent,  and  locally  homogeneous 
process  X  on  is  conditionally  strong  Markov,  However,  the  proof 
in  [5J  is  false  in  general,  unless  v;e  exclude  the  possibility  of 
paths  with  constant  pieces.  (Our  mistake  was  to  add  up  uncountably 
many  null-sets,  corresponding  to  the  possible  states  of  constancy.) 
The  following  counterexample  shows  that  the  difficulties  are 
intrinsic  rather  than  merely  technical. 


Example  2 .  Consider  a  Brownian  motion  B,  and  an  independent 
homogeneous  Poisson  process  with  jumps  at  . . .  Put  T^=0 , 

and  define 

=  1  B(  (  (t-k)  V  Tj^)  ,  t>0. 

k— 0 

Thus  X  consists  of  diffusion  parts  of  independent  exponential 
lengths,  alternating  with  constant  parts  of  length  1. 

Since  the  levels  of  constancy  B(rj) ,B(  r2) , . . .  have  diffuse 
distributions,  it  is  easily  seen  that  X  regenerates  at  every 
fixed  state.  But  X  is  not  Markov  or  conditionally  Markov,  even 
in  the  weak  sense,  since  every  fixed  time  t>0  belongs  with 
positive  probability  to  some  interval  of  constancy  (Tj^+k-1 , T^+k)  . 
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